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Abstract 

I present a new method to analyze Glauber dynamics of the Sherrington- 
Kirkpatrick (SK) spin glass model. The method is based on ideas used in the 
classical kinetic theory of fluids. I apply it to study spin correlations in the 
high temperature phase (T > T c ) of the SK model at zero external field. The 
zeroth order theory is equivalent to a disorder dependent local equilibrium 
approximation. Its predictions agree well with computer simulation results. 
The first order theory involves coupled evolution equations for the spin cor- 
relations and the dynamic (excess) parts of the local field distributions. It 

accounts qualitatively for the error made in the zeroth approximation. 
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The dynamical properties of the Sherrington-Kirkpatrick (SK) spin glass model [|IJ have 
been a subject of continuous interest in recent years |2| . However, almost all the theoretical 
studies considered Langevin dynamics of the soft-spin version of the SK model 0-0] • The 
soft-spin version, while showing very interesting dynamical properties ||, lacks the original 
motivation of the SK model: neither its statics nor its dynamics is exactly solvable |j| . The 
Glauber dynamics of the SK model was studied by Sommers Jt|. He recovered the results 
found previously for the Langevin dynamics. Sommers' method was criticized by Lusakowski 
|| and its validity is uncertain |J. Recently a novel approach to Glauber dynamics of spin 
glasses |10|JTT[1 has been proposed by Coolen, Sherrington, and coworkers (CS). The simple 
version of their theory |T(J describes very well the order parameter flow direction above the 
de Almeida-Thouless (AT) |~2| line but misses the slowing down which sets in when the 
former line is approached from above. The more advanced version |lTJ agrees well with 



the simulation data for short times but it remains to be seen whether it predicts divergent 
relaxation times at and below the AT line. 

Here I reconsider the Glauber dynamics of the SK model. The original motivation for 
this work was to improve the simple CS theory |TD|. However, the resulting method is very 
different from that of CS. 

CS tried to derive a general description of the SK spin glass dynamics. The theory 
presented here is more restricted: I study time-dependent spin correlations in equilibrium 
in the high temperature phase (T > T c ) at zero external field. The main motivation is 
simplicity: it is possible to derive explicit results for these correlations, and it is easy to 
perform accurate computer simulations that allow testing the theoretical predictions. 

Following an approach used in kinetic theory [pl|, I express the correlation functions in 



terms of a distribution that satisfies the master equation and a specific initial condition. 
Next I propose a series of approximations for this distribution that are motivated by the 
approximations used in the kinetic theory |TJJ. Successive approximations gradually include 
dynamic many-spin correlations. The static correlations are retained at every step. 

The approximations are formulated for a given sample of the coupling constants. The 



averaging over the samples is postponed until after the resulting evolution equations are 
solved. 

The simplest (Oth order) approximation is equivalent to a disorder dependent version of 



the local equilibrium approximation |15|] . It leads to very simple equations of motion for the 
spin correlations: the relaxation matrix is a product of a relaxation rate (kinetic coefficient), 
r -1 , that is finite at the transition temperature, T c , and an inverse matrix of equilibrium spin 
correlations, Aij, or the Hessian of the Thouless- Anderson-Palmer (TAP) |16| free energy. 
The Hessian acquires zero eigenvalues at T c [17]]. This results in a mean-field- like critical 
slowing down of the time-dependent correlations when T c is approached from above and an 
algebraic decay ~ t~ l l 2 at T c . A comparison with the simulation data shows that the the 
zeroth order approximation is surprisingly accurate. 

The first order approximation takes into account dynamic correlations between spins and 
the distributions of the local fields acting on these spins: it includes time-delayed Onsager 
reaction fields. 

The first order approximation accounts qualitatively for the error made in the zeroth 
order: the predicted difference between the full correlations and the zeroth order approxi- 
mation is about 40% of the simulation result. 

I now sketch the derivation of the results. I consider the Glauber dynamics for the SK 
model of a spin glass. The time evolution is given by the master equation for the spin 
probability distribution P(a;t), 

dP(<r; t)/dt = - £(1 - S>i(<r)P(o-; t). (1) 

i 

Here cr = {<ji, o~n} denotes the spin configuration, Si is the spin-flip operator, S^Oi = —a*, 
and Wi(cr) is the transition rate, tUj(<x) = (1 — 0* tanh(/3/ij))/2, with hi being a local magnetic 
field acting on the ith spin, hi = Jij°~j- The are the exchange coupling constants 
that are quenched random variables distributed according to the symmetric distribution 
P(^.)~ex P (-Jg/(2J 2 /iV)). 

I study the time-dependent correlations of the total magnetization in equilibrium, 



(1/iV) {m(t)m(0)) eq . Here m(t) = Y.i^iif) is the fluctuation of the magnetization (for 
T > T c at zero external field (erj) = 0), the angular brackets < ... > eq denote the equilib- 
rium ensemble average, and the square brackets [...] denote the sample averaging over the 



distribution of J^'s. 



I perform the sample averaging at the very last stage of the analysis. Therefore for the 
most part I deal with sample dependent quantities like {ci(t)m(0)) . This is analogous to 
the TAP |16|] analysis of the equilibrium SK model and to early work []T|,|T8|| on the Glauber 



dynamics of the SK model. It is different from the CS approach and also from most of the 
other approaches to both Langevin |3|-|5| and Glauber |7] dynamics. 

The correlations (crj(i)m(O)) are defined in terms of a conditional distribution P(cr; t\rr') 
and the equilibrium distribution P eq {(^) RI5| - I define a distribution P m (cr;t), 

P m (<x; t) = £ P(a; t\a')(£ <#^(<0- (2) 
tr' i 



The distribution P m satisfies the master equation ([I]) and the initial condition |2D 

P m (a;t = 0) = P eq {a)Y,<?i- 

i 

The time-dependent spin correlations in equilibrium (cj(t)m(O)} can be calculated as 
averages over P m , 

(^W0)>„ = E °i P m{°\ t) = (t). (3) 

Hereafter (...) (t) denotes average over the time-dependent distribution P m . In the following 
I propose a series of approximations for this distribution. 

In the zeroth approximation I assume that P m (t) can be expressed in terms of the single- 
spin averages, (crj) (t). More precisely, I assume that P m has the same form as an equilibrium 
distribution for the system in an external field with the field chosen in such a way that the 
single spin averages have correct values. Explicitly, 

P m (<T;t)^P eq (cr)J2vih(t), (4) 



where fields bi(t),i = 1, ... satisfy the following equations, 

(^>(*)=E< t7 i t7 fc>e, 6 *(*)- ( 5 ) 
k 

Solving Eq. @ for the I get 

P m (<x; t) « P eg (cr) ^ (TiAij (crj) (t). (6) 

Here the matrix A*j is the inverse of the matrix of the equilibrium spin correlations, 
J2j Aij (8<Jj5<Tk) eq = Sik- Note that Aij is identical to the Hessian of the TAP free energy 
0- 

The ansatz (Q) is similar to the local equilibrium approximation introduced by Kawasaki 



The new element of this work is to use the local equilibrium approximation for the 
disorder dependent distribution P m . 

To derive the equations of motion for the spin averages I start from the exact evolution 
equations, 

d (a,) (t)/dt = - (a,) (t) + (tanh(/^)> (t). (7) 

Then I use ansatz (g) to calculate the averages at the right-hand-side (RHS) of Eqs. (0) and 
obtain 

= ("1 + (tarm(«^g£^ W 3 ) (t). (8) 

According to Eqs. (|8]) the dynamics of the spin correlations follows a van Hove mean- 
field-like picture: the relaxation matrix is a product of the relaxation rate, r _1 = 1 — 
(tanh(/3/ij)(7j) , and the inverse matrix of the spin correlations (Hessian), A^. Each of Eqs. 
(§) contains an Onsager correction term |L| that has been introduced phenomenologically in 
early works PlJl8"f. Within the zeroth order theory the correction term is instantaneous: the 
reaction field at a given time depends on the value of the spin average at the same time. 

The relaxation rate can be calculated with the help of the equilibrium probability distri- 
bution of the local fields, P eq (h) Numerical evaluation shows that at T c the relaxation 



rate is finite. On the other hand the Hessian, Aij, acquires zero eigenvalues at the transi- 



tion temperature [[T7|] and this fact leads to a mean-field-like critical slowing down as T c is 
approached from above. Moreover, at T c I obtain asymptotically [(<7;) (t)] ~ t^ 1 ^ 2 . 

In the high temperature phase at zero external field the Hessian is known explicitly: 

A l3 = -(3J l3 +5 l3 {l + {f3Jf). (9) 

It follows that the evolution equations (f|) are almost identical to those derived in the original 
SK paper IJ. The solution has the same form as the solution of the SK equations if the 
time scale of SK is rescaled by factor r. 

In Fig. 1 I compare predictions of the zeroth order theory with numerical simulations 
of the SK model at the transition temperature. 10 samples of N = 10000 spins each 
have been simulated using algorithm of Mackenzie and Young [p^] . Very long equilibration 
time of 10000 Monte Carlo steps per spin (MCS) was used. Subsequently the data for the 
time-dependent correlation function (l/N)J2i ( cr «(^) cr i(0)) eg were collected |23|] and averaged 
over different time origins p3|. The figure indicates that the zeroth order theory is quite 



accurate: its predictions differ from the simulation data by less than 11%. In Fig. 1 I 
also plot predictions of the second order Sommers theory. They were obtained by solving 
explicitly Eq. (18) of Ref. 0, using the fluctuation-dissipation theorem to get the Laplace 
transform of the correlation function, and finally inverting the Laplace transform numerically 
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In Fig. 2 I plot the difference between the simulation data and the predictions of the 
zeroth order theory. It is clear that the zeroth order approximation is not exact. This fact 
can also be seen from an analysis of the short time behavior of the spin correlations: the 
zeroth order theory reproduces exactly the first time derivative at t — but not the second 
and higher order derivatives. 

To improve upon the zeroth order theory it is necessary to go beyond the local equilibrium 
approximation and include dynamic correlations flniEBf. It follows from the physics of the 



SK model and from the analysis of the short time expansion of the time- dependent spin 
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correlations that the first additional set of variables to be included are the dynamic (excess) 
parts of the local field distributions, 5Pi(h;t) JSTJ. They are defined as the differences 
between the true distributions and their values in the local equilibrium ensemble (|6]), 

SP i (h;t) = (5(h-h i )){t) 

-EW-W^iWW' ( 10 ) 

jk 

At t = the excess parts vanish, SPi(h;t = 0) = 0. 

To derive equations of motion for the spin averages and the excess parts of the local field 
distributions I need an approximate expression for the distribution P m in terms of (<jj) (t) 
and SPi(h; t). I assume that P m has the following form: 

P m (<r]t)nP eq (<T)(^a i A ij ((T j )(t)+Y i Jdhd^h-h,) JdqC lJ (h J q)5P J (q;t)\. (11) 

Here 5 e (h — h i ) is the microscopic expression for the excess part of the local field distribution, 

S e (h - hi) = 6{h -/**)-£ (S(h - hjaj)^ A, k a k , (12) 

jk 

and Cij(h, q) is the inverse "matrix" of the correlations of the excess local field distributions, 
Ej / dqC^h, q) (S e (q - h 3 )5\p - h k )) eq = S ik 5(h - p). 

The form of the distribution (pT|) is motivated by approximations used in the kinetic 
theory Briefly, to get (0) I assume that P m (t) has the same form as an equilibrium 

distribution for the system in the presence of external perturbations that are chosen in such 
a way that, at a given time, the single spin averages and the excess parts of the local field 
distributions are (<Ji) (t) and 5Pi(h;t), respectively. Now I will show that with the help 
of (|TT|) one can describe qualitatively the difference between the predictions of the local 
equilibrium approximation and the simulation data. 

First I derive equations of motion for the spin averages. I start from the exact equations 
(0), use (|IID to calculate averages, and obtain the following equations of motion, 

d{ ^ t {t) = -~£A,- fa) (t) + Jdh tanh(/?/0^(M- (13) 
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Next I derive equations of motion for the excess parts of the local field distributions. To 
this end I start from exact evolution equations, 

dSPi{h\ t) 



dt \ 

use the distribution ([H]), and get 

d5Pi(h;t) 



J2w l ( ( r)(l-S l )5 e (h-h l 



(*), 



(14) 



dt 







((3J) 2 tanh((3h) - (3h\ Pe q {h)- (a t ) (t) 

(ST) 2 Br d 

1 dq [P eq (h)S(h -q)- P eq (h)P eq (q)} I H ' C u (q, q')5P t (q' ';*), 



r d/3h 



df3q 



(15) 



where P eq {h) is the equilibrium local field distribution. To derive (|T5|) I keep two-point 
equilibrium correlations, e.g., (<?icrj) e , but I neglect higher order connected correlations 
involving different lattice sites, e.g., (S e (h — hi)5 e (q — hj)) e for i ^ j [2S]. 

According to Eqs. ( jT5|) the reaction field consists of two parts: an instantaneous reaction, 
proportional to the spin average at the same time, and a time-delayed reaction. It follows 
from (fT5j ) that the delayed reaction field acting on ith spin at a given time depends on the 
values of this spin at earlier times. 

Solving formally Eqs. (|l5| ) and substituting the result into Eqs. (|T3| ) one gets a set of 
effective equations of motion that involve only the single-spin averages. These equations 
have the same structure as the memory function equation derived recently by Kawasaki for 
dissipative stochastic systems |29]: the inverse frequency, r, gets renormalized by inclusion 
of the dynamic correlations. 

To derive explicit results for the time-dependent correlations I solve the integro- 
differential equation (|i~5"|) approximating 5Pi(h; t) by a finite sum of basic functions. 

In Fig. 2 I compare theoretical predictions for the difference between the full spin 
correlations and the local equilibrium result against the simulation data. The agreement 
is quantitative for short times (the first order theory reproduces exactly first two time 
derivatives of the spin correlations at t = 0) and qualitative at long times. 
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It is evident from Fig. 2, and it can be shown theoretically, that the first order theory is 
not exact. Glauber dynamics of the SK model is more complicated than statics: in addition 
to (possibly time-delayed) Onsager reaction fields other dynamic correlations have to be 
included. 

In summary, I have shown that the ideas of the classical kinetic theory of fluids can be 
used to analyze Glauber dynamics of the SK spin glass model. The very simple disorder 
dependent local equilibrium approximation leads to quantitatively accurate predictions for 
the spin correlations, at least in the high temperature phase of the SK model. This fact 
suggests that a disorder dependent approximation might be a good starting point in the 
search for a general theory of the SK model dynamics. Secondly, the error made in the 
zeroth approximation can be accounted for by including time-delayed Onsager reaction fields. 
The resulting theory can be improved further by incorporating more complicated dynamic 
correlations. Finally, the method presented here can be generalized to dynamics of neural 
networks and other Ising-like systems. 

I would like to thank Marshall Fixman for stimulating discussions and critical comments 
on the manuscript. This work was partially supported by NSF Grant No. CHE-9624596. 
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FIGURES 

FIG. 1. Spin correlation function at the transition temperature T c . Crosses: Glauber dynamics 

simulation data; dashed line: the zeroth order theory (local equilibrium approximation); solid line: 

the first order approximation; dotted line: the second order Sommers' theory. 

FIG. 2. The difference between the full spin correlation function and the local equilibrium 

approximation at the transition temperature T c . Crosses: Glauber dynamics simulation data; solid 

line: the first order approximation. 
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